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ABSTRACT 

The drive for improved school and classroom climate, 
for increased teacher and student involvement in decision-making, and 
for more positive teacher and student exr ctations are t>ecoming prime 
areas for joint educational and behavioral science efforts. This 
paper evaluates the effectiveness of a year-long classroom social 
competence training program (PI/PSP: Enhancing Classroom Climate 
through Pupil Involvement and Problem Solving with People) 
functioning as part of a larger Quality of School Life program to 
advance these goals. The progrsun examines elementary classrooms' 
ability to use an eight- step problem-solving sequence and reach 
consensus on effective action plans. Subjects included 8 classrooms 
that participated in the 21-lesson program and 8 classrooms that did 
not. All classrooms were evaluated at pre- and post-intervention via 
videotaped problem-solving sessions coded for ability to meet certain 
goals. Following training, program classes were significantly better 
than comparison classes at identifying a relevant main problem, 
focusing on appropriate means and ends, and reaching consensus on 
effective action plans. In contrast to comparison classes, program 
classes generated more effective solutions and fewer static responses 
and were rated higher on several decision-making climate indices. 
Results are discussed in terms of the implications of a year-long 
pupil involvement social competency training program. Included are 6 
tables, 3 appendices, and 34 references. (Author/MLH) 
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ABSTRACT: The pre'^dftt study evaluated the effectiveness of a year-long classroom social competence 
training program (QSL.Pi IPSP)for upper and lower elementary school classrooms: it examined the ability 
of total classrooms to^ utilize an eight-step problem-solving sequence (PSP) and to reach consensus on 
effective action pldns. Subjects included 8 classrooms which participated in the 21 -f lesson program and 8 
comparison classrooms which did not. All classrooms were evaluated at pre- and post-intervention, via 
videotaped problem-solving sessions, coded for ability to follow sequence, observational/empathy skills, 
antecedent thinking, problem identificcaion. ^ectiveness and content of means/ends suggestions, consensu- 
al action planning, and group decision-making climate. Following training, program classes were signif- 
icantly better than comparison classes at identifying a relevant main problem, at focusing on appropriate 
means and ends, and at reaching consensus on ^ective action plans, in contrast to comparison classes, pro- 
gram classes generated a significantly greater percentage of effective solutions and fewer" static*' responses. 
Program classes were also rated higher on several relevant decision-making "climate" indices. Results are 
discussed in terms of the implications of a year-long pupil involvement (Pi) social competency training 
program, with support for attention to whole-class effects. 



Two contempoiary publications — one from the National Commission for Excellence m Educa- 
tion (1983) and the other from the U.S. Department of Education (Kyle. 1985) — have identified a number 
of specific foci for educa vnal reform. Because these and similar publications have highlighted and legit- 
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imized specific correlates of educatic/ial efTectiveness and excellence — school boards, administrators, and 
teachinc staffs of the nation's schools have been investing considerable amounts of resources, time, and at- 
tention to changing the ways teaching and learning occui. Several of the identified "effectiveness'' and 
"excellence** correlates reflect the need for an educational and behavioral science collaboration, in order to 
create an a^Tpropnate technology for widespread attainment of these goals. The drive for improved school and 
classroom climate, for increased teacher and student involvement in decision-making, and for more positive 
teacher and student expectancies are prime areas for joint educational and behavioral science efforts. 

This paper reflects a partial evaluation of a K-6 curriculum, Pl/PSP: Enhancing Classroom 
Climate through Pupil Involvement and Problem Solving with People (Schelkun, 1987), which functions 
as a portion of a more ambitious four-level "systems'* intervention to advance these goals by enhancing the 
Quality of School Life for elementary schools (QSL-E). PflPSP is an enhanced, year-long social 
competency training program, based on er.tensive development and research of related concq)ts and curricula 
since the 19S0*s. It brings together three major strands of intervention and research: (1) Social competency 
training, via similar, structured, interpersonal cognitive problem-solving curricula, (2) Organizational 
development (OD) "systems interventions,** via structured organizational development training and 
consultative interventions, and (3) QuaUty of Wwk life/Quality circle (QWIVQQ employee involvement 
models, which have become standard throughout business and industry. 

HISTORICAL CONTEXT 
Social competency training 
During the 1950*s and early 60's, Ralph Ojemann (1961) pioneered and popularized a system of 
behavioral science collaboraaons with educators. He and his colleagues at the Educational Research Council 
of America (ERC A) developed, researched, and widely disseminated attractive, easily accessible, elementary 
school curricula for "causal learning** through "antecedent- and "causal** thinking (Muus, 1960). Then, dur- 
ing the 1970*s, an "affective education** movement prematurely deluged the schools with a broad variety of 
appealing materials, many of which represented fairly ambiguous attempts to develop children's empathy, 
self-esteem, and social problem-solving abilities. Many of these programs were opportunistic, conceptually 
vague, and lacked credible research support They also included a number of methodologies, soon to be con- 
demned by influential religious anU political constituency, which labeled them as exemplars of a danger- 
ously invasive "secular humanism.** This ambiguity, lack of a credible research base, some excesses, 
political vicissitudes, and the "back to basics" movement in education ended the meteoric rise of affective 
education, so thau today, only a few of the multittide of identified curricula and teaching materials (Morse, 
W.C. & Munger, RJL., 1975) are still readily available to educators. 

However, a parallel and more focused line of research and curriculum building has been more 
quieUy initiated, developed, researched, and disseminated during the past twenty years — concentrating on 
activities vvhich enhance children's social competencies through "cognitive" social problem solving activi- 
ties. Although affective and empathic concepts are included, these are subordinate to the major goal of en- 
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hancing measurabk competencies, which research has shown to correlate with the school's now identified 
objectives of improved classroom climate, improved participation and involvement, appropriate deportment, 
and enhanced productivity — as well as ^Ued behavioral scientists' goals directed toward the promotion of 
positive well-being (Cowan. 1977). Other pioneers in social competency training for children. Myrna 
Shurc and George Spivack — along with their colleagues in Philadelphia — have devoted the past two 
decades to carefully evaluating their Interpersonal Cognitive Problem Solving (ICPS) curricula for pre- 
schoolers and elementary school children (1982). These cuiricula have provided the impetus for further cur- 
riculum development by the "Rochester group." with their Social Problem Solving r^^PS) curricula 
(V/eissbcrg, Gestcn. Licbenstein. Doherty-Schmid. & Huiton. 1980; Work. 1986). a? well as the more re- 
cent New Jersey-based Improving Social Awareness— Social Problem Solving (ISA/SPS) curriculum 
(Elias.Gara.Ubriaco, Rothbaum. Clabby. & Schuyler. 1986) and the Michigan-based Pupil Involve- 
ment/Problem Solving with People (PI/PSP) curricula (Schelkun, 1987; 1985) discussed l:cre. 

Social Systems Interventions and Quality of Work Life (QWL): 

For many reasons, school systems have proved remarkably resistant to sustained change, and a 
variety of "change agents'* have rxommended "systems'" and "wganizational development" interventions for 
those who wish to implement lasting differences in the way school personnel interac with children and 
with each other. (AUen, Chinsky. Larcen. Lochman. & Selinger. 1976; Schmuck. & Runckel 1985). The 
tout, four-level Quality of School Life (QSL-E) program serves as the organizational context for Pupil Li- 
volvement through Problem Solving with People (PI/PSP) classroom training. The total program is based 
on industry's Quality of Work Life/Quality Circle (QWL/QQ programs, which provide training, structure, 
and legitimacy for appropriate employee involvement and participation 'n organizational problem solving 
and decision-making. Pioneered and popularized by Deming (Walton, 1986), supervisor/woricer Quality 
Circles have become widespread in business and industry, and Deming's standards have been adapted to a 
variety of settings, including portions of the public sector. The Quality of Work Life (QWL) model is a le- 
gitimized, standard, highly structured, systematic ^roach to employee participation: as such, it is readily 
transportable and may be disseminated across a wide range of organizational settings and culture.^. With ap- 
propriate alterations, the model has proved adaptable to school districts, and Quality Circles (PI/PSP Cir- 
cles) in the elementary school classrooms are creating and maintaining changed teacher-student relation- 
ships, much as supervisor-worker relationships are altered in the CEictories. 

THE PRESENT STUDY 

The major questions investigated in this soidy involve the QSL:PI/PSP curriculum's potential to 
teach concepts and skills similar to those investigated by researchers who have reported results of the ICPS 
arKi SPS curricula. Such studies have demonstrated a variety of beneficial effects on a large number of indi- 
vidual competencies (Spivack, Platte and Shure, 1976; Weissberg et al,1981; Elias, Gara, Ubriaco. & 
Schuyler, i<)82; Elias et al, 1986; Urbain and Kendall,1980), especially when the problem-solving training 
has been targeted for specific tasks (Durlak,1983). Students' sense of involvement, a major objective of 
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the PI/PSP cuiriculum, h&s been linked by at least one study to improved classroom climate, reduced 
problem behaviors, and high social competence (Wright,Cowcn, & Caplan, 1982). Most previous studies 
rep(Hting these results have focused on improving the competencies of children as individuals. The study 
reported in this paper expands the unit of analysis to target the teacher/student classroom as a single 
functional cluster, using a presentation method and coding paradigm ( Hallarman, Aberbach & Schelkun, 
1987) similar to that of the OMI, used by the Rochester group (Polifka, Weissberg.Gestcn, Flores de 
Apodaca, & Piccoli,1981) to investigate individual abilities. (Individual student effects of the QSL: PI/PSP 
curriculum, reflecting tlie OMI and o Jier measures, will be reported in future publications.) 

The current study investigates a portion of a larger, system-wide program, the Quality of School 
Life (QSL-E) Program for Elementary Schools. QSL-E is a structured, four level "system:** intervention 
targeted to involve the following four layers of a school district (1) elementary school cU^srooms 
(I^l'PSP), (2) school teachers and other staff OT/SI), (3) families (FI), PiPi (4) an administrator/unior 
representative Steering Committee (S-Q (Schclkun, Tableman, Cooper, & Groves, 1987). During 1984-5, 
the program was begun in a single elementary school, as a pilot demonstration for District A, whose Board 
then committed to a five year plan for full*system programmatic dissemination. The present study reports 
on a portion of Pupil Involvement (PI/PSP) data collected in 1985-6; similar analyses for the second 
evaluation year (1986-7) will be presented at a later date. 

One major difference in this study is the focus on the observed problem-solving abilities 
of the entire class unit of teacher/students, rather than on individuals — since the ultimate goal of the QSL 
program's PI/PSP intervention is to improve classroom climate and the way teachers and children mxtt^A 
during the school day. Hypotheses were related to the teacher/child unit's ability to perform social-probtem- 
solving activities similar to those reported in studies which focus mainly on individual skill-bwlding. 
Here, the major questions involved the ability of the more extensive PI/PSP curriculum to provide skills 
similar to those previously reported, using the more problem-oriented and individually-focused ICPS ana 
SPS strategies. 

METHOD 
Participants and Setting 

The study was conducted in two mid-sized urban communities in Southeastern Michigan. The 
eight program. Pupil Involvement, classrooms (PFs) were recruited from three participating elementary 
schools in the Program District (District A). Because the goals of the larger QSL-E Program required con- 
tinued dissemination of materials and training throughout District A, the eight compari:ion classrooms 
(non-Pi's) were recruited from a single school in a neighboring district (District B). (School personnel's de- 
scriptions of child populations led to the perception that the program and comparison schools' populations 
were functionally equivalent) 

With cooperation from the building administrators, project staff recruited classrooms during school 
staff meetings at the close of the preceding school year, and both program and comparison classrooms were 
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volunteered by their teachers. All classrooms volunteered by teachers from the four evaluated grade levels 
were accepted- Each participatLng teacher was paid a niodcsi stiocnd for three periods of full data-gathering 
($150). half at the beginning and half at the end of the school year. Parental pennission was received for 
100% of the students in comparison classrooms; however, no permission was required for the program 
classrooms, since the evaluation inflected programming which had been approved by the District for general 
use throughout the District 

The scope of this paper reflects approximately one third of the data collected n 1985-6; the re- 
mainder will be analyzed and rlist 'ssed in future rqpons. 

This report contrar y the social problem-solving abilities of the -aincd "Pupil Involve- 
ment** problem-solving classrooms (PI Circles) with comparable, untrained classrooms, noting whether and 
how they engage in (l)coiK:rete and empathicobservadon (2) rdevant antecedent thinking. (3) identifying 
relevant problems, (4) effective mcans/'inds thinking, and (5) reaching consensus on an appropriate action 
plans. Observed teacher and student behavkxs relating to school climate will be briefly noted 

The instructional phase of this study consisted of 21+ lessons (a number of supplemental lessons 
being optional). Each lesson was taught in 15 minute segments, and teachers were encouraged to take as 
many days for each lesson as seemed necessary and comfortable. (The lessons averaged 2 • 4 sessions.) Es- 
sential features of each lesson were highlighted, and teachers were instructed to ad^ the remaining content 
to suit tiieir personal style. Problem-solving sessions were held continuously, from October through May. 
Teachers were encouraged to hold Pupil Involvement problem-solving sessions (PI Circles) daily; however, 
the press of other matters produced an average of 2-3 weekly sessions. Teachers were encouraged to inter- 
sperse PI uaining sessions (curriculum) with "real-life** classitwm PI problem solving, and to hold tiieir 15 
minute problem-solving sessions at a predictable time each day. 

The structured QSL: PI/PSP training utitoed a "clean draft** of die ^present version (Schelkun. 
1987). which contains 5 scripted units, whose content was determined during 15 years of school consulta- 
tion by staff of \ht Washtenaw County Community Mental Healtii Center's previous Behavioral Science 
Education Project (BSEP). Units I-Ed provide the classrooms witii concepts and skills which experience has 
shown to be useful as a cognitive and behavioral context for classroom problem-solving. (These units pro- 
vide sinular procedures — for understanding the "big picture.** for managing discussions, for data-based fact- 
flnding. and for recommending solutions — tiiat are utilized in training adults for industry's QWL pr> 
grams.) Unit IV contains \bc basic 8-step PSP sequence — an extension of work by ERCA. and tiie ICPS. 
SPS models previously mentioned. Unit V adapts the single-focus problem-solving process to the dyadic 
process of negotiation. 

This study investigates tiie class units' skill acquisition for Unit IV in tiie Pl/PSP curriculum, 
which contains a ntimber of story outlines, from which teachers select those which fit the realities of tiieir 
classrooms. Lessons followed a sdtictured problem-solving sequence, using specifled prompts for various 
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segments of the 8-step process. To maintain focus on the problem and to assist with vis» al learning, 
visible prescntatioas of ideas developed during the planning process were preserved ana posted on a 
structured -storyboard" and/or on newsprint (APPENDIX A: Sample story ouUine and storyboard). Each 
Pupil Involvement session was interrupted soon after an audible timer announced the end of the 
recommended 15 minute time segment; unfinished sessions were summarized and resumed at the next 
meeting of the PI Circle. 

As needed^ program teachers had access to weekly consultation by QSL staff during the 
1984-5 school year; comparison tcvhers received none. Teachers in comparison classnwms were told that 
we were studying the natural development of a classroom's problem-solving skills over a typical school 
year, and that if they wished, in the following year we would offer them consultation, training, and a cur- 
riculum inat might help the class improve these skills. In a relationship-building effort program and com- 
parison staffs were provided with teachers' stress management training workshops during the evaluation 
year. 

Each program classroom was provided with the appropriate level •*clcan draft" PI/PSP cumculum, 
along with a m mbcr of teaching aia : a packet of stim ilus cartoons, a digital timer, several pads of lined 
newsprint, "feelings'* posters, a '*3 D;, for Telling- poster, blank dry-erase "story caris" for use on the sto- 
ryboard, a plastic ASK ME/TELL ME disk, a roll of heavy twine for use with the "Personal Space" lesson, 
as well as sock puppets, for grades 1 and 2. Program teachers received 15 houn of general PI skill training 
in late August, prior to the school year. At that time, they were merely introduced to PSP skills and, fol- 
lowing the fust stage pf data gathering, were offered follow-up training and consultation for the more com- 
plex 8 stq) problem-solving sequence (PSP). Teachers were re-reimbursed for attending this training at the 
normal District rate of $12/hour. 

Assessment 

Selection of subject classrooms 

Eight intervention (program) elementary school classrooms and eight grade-matched compari- 
son classrooms participated mthis study Two program classrooms from each grade level (1,2,4, 
5) were selected finom three elementary schools in District A; comparison classrooms were similarly 
selected from a single school in District B. Description of key demographic indicators, such as 
racial composition, gender, California Achievement Test (CAT) scores for reading and mathematics 
and perceived socio-economic status (SES-P) are summarized in TABLE 1. (SES -Pis an estimate of 
teacher "expectation," based on *he address of smdent*s residence.) 
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DEMOGRAPHIC SUMMARY 





PROGRAM 


CLASSES 


COMPARISON 




PERCEIVED SES 










LOW (%) 


32 




02 




ME) (%) 


40 




67 




fflGH(%) 


23 








GENDER 








MALE (%) 


56 




47 




FEMALE (%) 


44 




53 




RACE 








CAUCASL\N (%) 


64 




73 




BLACK (%) 


32 




12 




HISPANIC (%) 


1 




2 




ARABIC (%) 


1 




2 




AMINDL\N (%) 


0.5 




0.6 




ACHIEVEMENT(CAT) 








READING 


4.5 +/- 


2.4 


6.1 +/- 


3.2 


MATH 


4.3 +/- 


2.0 


5.4 +/- 


2.5 



Sdmuius presentation an d class ducuxxinm 

The current study utilizes coded videotapes to investigate classroom competence for the UNIT IV: 
PSP portion of the PI/PSP social-competency curriculum, and examines teacher/student behaviws while the 
class engages in a typical social-problem-solving activity. (Consultants kept weekly activity logs during 
the school year, to indicate whether teachers utilized the PSP unit to criterion, a minimum of 3 storyboaid 
situations and 3 "real life** classroom problem discussions.) In the fall of 1985, and again in May, 1986, 
teachers were presented with the same ''stick figure** cartoon, depicting three children at play, and a fourth 
child (Terry), "left out** of the fun (APPENDIX B). Teachers were given minimal instructions: (a) to meet 
with the total class, (b) to identify the depicted siuiation, and (c) to "hold a discussion with the class, in or- 
der to help Terry solve the presented problem.** They were given no time limit, and the full discussion was 
videotaped in a single session. Additional informadon about the problem situation was printed on the re- 
verse side of the stimulus cartoon. Average videotaping time was 4S minutes, following which, each class 
was permitted to view its videotape. Group behavioral sequences were coded for all videotapes, according to 
criteria (APPENDIX C) similar to those developed for assessment Oi individual problem-solving behaviors, 
by the Rochester Group vTolifka, Weissberg, Gesten. Hores de Apodaca, & Piccoli, 1981). 
H \j/Otheses: 

Hypotheses in this study were as follows: (1) That, in solving a specimen problem, the trained class units 
would demonstrate more and better sequential group problem-solving behaviors than the untrained uniis; (2) 
That the trained class units would produce more appropriate action plans than untrained classes; (3) That 
the trained class units would focus more appropriately on effective problem solving strategies; (4) Thai the 
trained classes would waste less effon cn repetitive and irrelevant verbalizations than the untrained 
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classrooms; and (5) Thai the trained classnwm units would improve more in behaviors that reflect an 
appropriate problem solving "climate** than the untrained classroom. 
Data AnalvsLv, 

(1) For program and comparison groups, we computed the percent (%) of the following: 

• PSP dichoiomous (yes/no) sequence items; 

• alternate (ALT), variant (VAR), chamed (CH) and irrelevant (IR) solutions provided; and 

• content categories for ALTs; 

(2) Pre- and post-intervention frequency differences between groups were then compared, using 
X2 tests of statistical significance ; 

3) Intcrvally-scakd PSP relevancy items and measures of observed classroom climate were ana- 
lyzed, using appropriate small sample size parametric statistics. 
Direction of scores 

In order to improve reporting, coding was scored in a positive direction. When reading the follow- 
ing charts, except for "static** scores (VAR's, CITs, IR's), increasing scores indicate more positive results, 
regardless of the verbal descriptors. 
Inter-rater Reliability 

The kappa statistic, a measure of intenratcr reliability, corrects for chance-expected agreement 
(Cohen, 1960; Fleiss, 1981). Kappa coefficients for select PSP sequence items were calculated, to 
determine the degree of agreement among trained videotape raters. Kappa coefficients for problem 
identification, best and worst ending, and alternative solutions with consequences ranged from mod- 
erately good (.62) to excellent (1,0). 

RESULTS 

Ability to follow the prnhlem'Solvin f seqiutnc^ 

X2 comparisons between % frequencies for PSP Sequence iicms in program and comparison 
classrooms at pre- (Time 1 ) and post-intervention (Time 2) arc summarized in TABLE 2. 



TABLE 2 



Of special interest are those PSP Sequence items, where groups had been comparable at 
Time 1, but significantly differed at Time 2. These PSP Sequence items (described in APPENDIX C) 
include: 2C, 3C, 5B, 5C, 6A, 7A, 9A, and lOA . With the exception of item 2C (where Students 
provided suggestions for situational an/«c«<i^ntr), percent frequencies were significantly greater at post- 
intervention for program claf'.'ooms than for comparisons. The differences in item IB also showed 
improvements in the program group's abilities, approaching statistical significance. 
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Relevancy to stimulus xituatinn 

Comrarisons between groups for relevancy items (ID. 2D3D) showed no significaiit differ- 
ences prior to the intervention (Table 3). 
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However, a highly significant difference between groups emerged at post-intervention for item 3D , 
indicating that program classrooms werebetter able to identify a jpeci^c and '-W^t/onr/om foi Terry's 
problem than were comparison classrooms (x2 (14) « 2.9S, q < .01). 
Effectiveness of solutions to problem sitwitinn 

Analyses of solution effectiveness show some significant differences in the number of (1) ef- 
fective alternate (ALT), and (2) ineffective C'static**) responses between groups at pre- aiid post-interven- 
tion ( Table 4). 



TABLE 4 



("Static" responses are deflned as three types of ineffective response: variant (VAR), chained (CH), 
and irrelevant (IR) responses. Exan^ples are presented in APPENDIX C). The "static" vs. effectiveness 
comparisons are more readily observed when viewed in grs^hic form. 



FIGURE 1-A 



Figure 1-A shows effective suggestions (ALTs) displayed against the less effective VAR's, CITs, 
and IR's; whereas Figure 1-B combines the three types of ineffective "static" responses and displays their 
totals against the effective ALTs. 



HGLTIE 1-B 



Figures 1-A and 1-B compare classrooms for % frequencies for ALT vs. "stati^*^ solution 
effectiveness responses at pre-and post-intervention. x2 comparisons showed that, at post-iniervention, 
program classrooms offered a significantly greater frequency of effective, ALTy and fewer ineffective^ 
"static," solutions than did the comparison classrooms (x2 (1)^7.46, b<.01). 

At pre-intervention, there were no significant differences between classrooms for total 
number of effective (ALT), nor for two types of ineffective (VAR and IR) responses. In contrast to 
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the comparison group, program classrooms showed a significantly greater number of effective (ALT) 
responses than did comparisons (x2 (1) » 3.95, fi < .05), had decreased significantly in the number 
of ineffective WAR responses (x2 (1) « 2.7, b<. 10) and showed a mariced decrease in ineffective IR 
responses. Although the program classroom had a signifitanUy greater number of ineffective {CH) 
responses than the comparison classroom prior to training (x2 (1) « 9.3, <. 001) — by Time 2, pro- 
gram classrooms had improved to a comparable level, showing a decrease in their previous ineffective CH 
responses at Time 2. 
Content of effective solutions (ALTs) 

Comparisons of solution contf.nt for both groups* effective suggestions (ALTS) — ( Figure 
2 ) — indicated that at Time 1 there was significantly greater help-seeking conicnc in the responses 
provided by the program classrooms(x2 (1) » 5.34, p< .05). At Time 2, the program classrooms had 
reduced the number of help-seeking solutions, so that post-intervention comparisons then indicated no 
significant differences between groups for help-seeking content (For this "friends-seeking*' situation, 
Tielp-secking** C'Ask the teacher to make them play.'O and "non-confrontation*' C'Jusi go away.*Owcre pre- 
judged to be inferior to such strategies as "direct action*' TShow them you know how")and *Verbal asser- 
tion.^CTell them you'd like to play'O- 

I FIGURE 2 I 

/ flcr training, significant differences emerged for responses involving dUrcct action (x2 (1) « 
4.46, a < .05) ard for non<onfrontation (x2 (1) « 10.65, n < .001). Program classrooms suggested ef- 
fective responsf s which suggested more direct action (do something specific); whereas comparison class- 
rooms increased their suggestions for non-confrontational (back ofO content Results also indicated a 
trend toward increased verbal assertion (say something — nonaggressive) among program classrooms 
at Time 2. 

Classroom discussion climate 

Observed classroom discussion climate data, rating children's behaviors (Climate-Q are sum- 
marized in Table 5. (Discussion Climate variables are described in APPENDIX C) 



TABLE 5 



Results indicate that comparison classrooms initially showed more effective classroom 
interaction skills than did program classrooms; however, at post-intervention, program students had 
improved, and for various measures of effective classroom behavior, were showing levels of 
performance comparable to those of the previously more highly socializeo comparison classrooms. 
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Ratings of teacher behaviors during the filmed problem-solving discu'^ion arc summarized in 

Tabled. 



TABLE 6 



At post-intervention, program teachers provided significantly greater visual feedback {coAts IS, 16) to 
students and utilized a significantly wider scope of fact-finding techniques (code 18) than did 
comparison teachers. In addition, trends in a positive direction emerged at post intcr/cntion for the pro- 
gram classrooms, for all additional activities coded for teachers; whereas teachers in the comparison 
classroom showed some trends in the negative direction ^reminding children to sit appropriately (9) and not 
exploring feelings as port of fact-finding (17). 



DISCUSSION 

The present study assesses an expanded social-competency training curriculum, which adds to a 
structured problem-solving sequence, to provide additional group problem-solving skills — similar to 
those utilized in industry's Quality Circles, where worker/supervise* units meet regularly in the work site to 
identify to identify and solve woric-related problems. Over thirty years of research, development, and 
implementation of social competency training curricula for elementary schools (Ojemann, 1961; Shurc & 
Spivack, 1982; Dinkmcycr, 1974; Wcissberg, Gestcn, Licbenstcin, Dohcrty-Schmid, & Hution, 1980; 
Elias, Gara, Ubriaco, & Schuylcr,1982; Durlak, 1983), have demonstrated positive attitndinal and 
be^vioral effects of training children in social problem-solving skills. These improvements have largely 
been linked to individual attributes, derived from the use of structured lessens which demonstrate both 
cognitive and affective approaches to social problem-solving. 

This study expands the research unit of analysis to the entire teacher/student cluster, investigating 
some results of a five- unit, group social competency curriculum (QSLiPVPSP), in which die basic, struc- 
tured, social problem-solving (PSP) model comprises only one fiftl^i of the suggested Pupil Involvement 
(PI) content The remainder of the curriculum includes training in group communication and task-ielated in- 
teractions (Unit One); four aspects of group management: rules, iK)nns, environment, and self-control (Unit 
Two); a cognitive review of emotions as motivators (Unit Three); application of fact-finding and other 
problem-solving activities to classroom situations (Unit Four); and expansion of problem-solving skills to 
parallel-cluster situations which require additional skills in negotiation (Unit Five). 

The Hrst four hypotheses in this study were significantly supported by analysis of pr^- and post- 
training videotaped classroom problem-solving sessions: Trained groups (1) demonstrated more and better 
sequential group problem-solving behaviois. (2) produced more ^propriate action plans. (3) focused more 
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sppropriatdy on effective problem-solving strategics, and (4) wasted less effort on repetitive and irrelevant 
verbdizations. ?n addition, there were trends in the expected direction for effective student and teacher 
behaviors during the problem-solving discussions. 

Tiicsc findings arc particularly noteworthy when we examine the demographic differences between 
the two groups. When selecting the comparison group, we had not been informed of the extent to which 
"busing- caused the two groups to differ in such important variables as socioeconomic i^ialus, cultural het- 
erogeneity, and aL;ademic achievement These differerces made comparisons difficult when using individually 
focused measures, such as th^ OMI, because individually rated "comparison** lildren began at such a high 
kvel of competence that the significant improvements in program children could not confidently be reported 
as resulting from the progranmiatic intervention. However, we are far more confident here, when reporting 
results of the teacher/student unit's problem-solving challenge, since both groups were statistically compa- 
rable on most reiaud measures, prior to the intervention. (Further analysis of individual competency is 
planned, with more comparable groups to be studied for skill and behavioral similarities and differences.) 

For this study, the major questions hinged on issues related to teacher implementation and 
acher/student acquisition of skills: Would they/Could they perform to the criteria targeted by the groi'p 
social-problem-solving portion — embedded, as it was, in the larger curriculum? The data suppr^irts the 
belief that they can. (However, when the data is analyzed by grade level, positive trends arc more 
pronounced for the upper elementary classrooms than for the lower. It is likely that the practice crit^^r^ will 
need to be increased for the younger children: future studies with grades K-2 will increase suggested time 
allotments for concepts and skills targeted by Unit Four of the QSL J^IrPSP curriculum.) 

Some practical implications of this study are found when closely examining the problem-solving 
sequence. The methodology involved a completely "open** problem-solving interview: the teachers were 
given the stimulus cartoon and a few simple instructions. Then, they were on their own, much as we are 'n 
"real** life. Untrained classes became busily and hqypily engaged in their extensive discussions and reported 
enjoying the process. However, despite the untrained class's abiL:y to offer as many good ideas (ALTs) at 
both early and later sessions* these good ideas were embedded in a lot of other talk (ineffective "static** re- 
sponses) and were not recorded for further consideration. Consequently, the trained classes outperformed the 
untrained groups in being able to carrying the ideas forward: A significant number of trained classes formu- 
lated fruitful action plans, while none of the untrained classrooms did so. Examination of the data shows 
that the group proble.nri-solving process seems to deteriorate at the point of antecedent thinking (What might 
have led up to this situation?) and prob' identification (What might be the main problem?) — with 
children in untrained classes going otf in a number of promising but uncontrolled directions, so that un- 
trained classes do not reach any consensus on what a child might do to resolve the difficult situation. 

It is interesting to note that, at the next level of QSL intervention. Teacher Involvement (TI) 
training points to a similar lack of focus when problem solving is attempted at the staff level: Untrained 
teacher/administrator groups interact actively, with many excellent suggestions — but no record of discus- 
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siOD b presented and do explicit problem-solving sequence is foilowcd. They rarely reach definite recom- 
mendttioni or concVodons, and this process often results in frustration and cynicism — "What's the use," 
•They don't listen.- •They don't care* It is possible that teacher resistance to student empowerment in 
classroom decision-making derives from their belief that discussion may be an end in itself, but that it is 
not expected to lead anywhere. 

A related finding is the fiKt that good verbal skills and numbers of good suggestions do not predict 
a "fit- of problem to suggested solutions: r' lwugn the verbally skillful untrained comparison classroom 
offered more "good ideas*' (ALTs) during pre- and post- discussions, children in tf^ 
more confident of their competence in reaching the goal of "making friends.** They were significantly more 
likely to take i^ropriate direct action, while the comparison groups were more likely to suggest less 
effective withdrawal from the situation. Examination of die order of responses showed mm than half of the 
effecave ALTs were offered in the first four responses, with quality strongly dropping ofif after eight 

Several hoped-for outcomes were observed by die consultants. Teachers of trained classrooms were 
continually suriHised at the children's wisdom, reasonableness, and ability to find appropriate solutions 
more suitable for their peer norms than those the teacher had considered. Teachers who were originally quite 
skeptical of empowering their students became more willing and able to delegate appropriate problem- 
solving procedures to the chiklren, with the result diat the process became more a team effort in the trained 
classrooms — with teachers becoming more participative and less direcuve. 

A shortcoming of this study is that it did not include outside behavicml and climate-related out- 
comes. The social, competency literature has far more studies — like die present one — which focus on 
skill acquisition. It is more diffi^^ult to design studies which convincingly point to improved behavioral 
consequences (Winer,Hilpert, Gesten,Cower « & Schubin, 1982), and most of diose who repon such effects 
focus on die behavioral adjustment of individual children. The coding criteria for diis study's group prob- 
lem-solving process were based on similar criteria developed by researchers who have studied individual ef- 
fects (Muus, 1960; Polifka« Weissberg, Gesten, Flores de Apodaca, & Piccoli, 1981), increasing the likeli- 
hood Uiat such effects as milder reaction to schod stressors (Elias et al, 1986), improved reactions to major 
transitions (Spivack & Shure, 1984; Elias, et al, 1986), and many audiors' reports of improved behavioral 
adjustment (Spivack & Shure, 1984) may be found in children trained in PI/PSP procedures. 

For a number of reasons, it seems worth-while to include investigations of the Pl/PSP curriculum 
(as well as the abbreviated format, in die Michigan Model for Comprehensive School Health Education 
curriculum), as behavioral scientists continue to attend to die field of social competency training for 
elementary school chiklren. This study indicates diat PI/PSP is able to develop classroom skiUs similar to 
diose developed for individuals dirough die IGPS ^nd SPS curricula. Since PI Circles meet for die full 
school year, the PI/PSP curriculum satisfies a recognized need for die extended period of clafsroom 
training, which has been recommended by e number of audion (Muus, I960; Spivack Sc Shure, 1984; Elias 
et al, 1986). It also trains for ana encourages the teacher to incorporate systematic problem-solving 
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st-aicgics into the school day — through •^dialoguing- and other methods — as has also been recommended 
in the Uteiatuit (Weissbcrg et al, 1981: Spivack Sc Shurc, 1984). The curriculum has been designed for 
large-scale dissemination; it meets ecological objectives (Trickett, 1984) not highlighted in other curricula; 
it trains to alter specific ways that teachers and children relate to one another, and it avoids a number of 
specific political pitfalls which sometimes mm away school boards and administrators in deference to 
constituencies whkh associate certain procedures with •'secular humanism" (Schlafly, 1986). 
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Appendix A 

Sairple Storyboard and Abbreviated Lesson Outline 



F. MAKING GOOD; TERRY WAS CARELESSTI 

LEARNING OBJECTIVE: Children learn ways to responsibly face the consequences when they make 
dcstnictive mistakes: (1) to CALMLY and specifically accept responsibility for the consequences, (2) to 
make appropriate restitution, and (3) to state what they have learned for the future. 



MAIN PROBLEM: Ttrry brokt th« fishtank. 
BEFORE NOW 



WHAT IF?... arxj THEN? 




ACTION PLAN: Tarry rascued the fish; thm told th« ttachar s/ha was sorry; and than savad 
up to raplaoathatank. 



Best Erdlng 



d ii's 0 K. 




THE WHaE STORY: Tarry arKl Garry wara fooirtg artHmd with sticks, and Tarry knocfcwi ovar tha 
fishtani^ and it Droka. Than. Tarry... 



ACTIVITIES: 



1. The cartoon suggests one possible solution to Terry's problem: Terry gave Geny a stick and showed 
Gerry a new trick to try with it (BEFORE). Terry was being rowdy and backed into the fish- 
tank Jmocking it over, breaking it, and spilling the fish on the (toot (NOW). The Teacher follows the 
STORYBOARD process, as demonstrated in TERRY AND THE ROPE. 



2. For Teacher's turn during the "MAIN PROBLEM" BRAINSTORM, the Teacher suggests that Terry has 
two PROBLEMS, and suggests that Terry save the fish first, then the remaining MAIN PROBLEM — 
"making gootf* can be solved by the class. The Teacher makes it clear that LISTING PROBLEMS 
is helpful, because ii sometimes shows us that we aren't finished when we solve one pan of the prob* 
lem simation; sometimes we have to solve several parts before we are finished. 



J. For Teacher's turn during "WHAT IF?" BRAINSTORM about Terry's responsibUity for the problem by 
MAKING GOOD, the Teacher elicits or offers responses which show remorse (Terry says s^e is sorry) 
and which show an attempt to make up for actual damage (Terry works it off in classroom chores; Terry 
saves his/her allowance and buys anotho* fish tank; Terry brings his/her tank from home, etc) Children 
discuss 3 needs: "being sorry, to remind us next time,** making material amends — within our means — 
to "make good** the damages, and our he^g others "make good,** instead of punishing them. 



4. During the discussion of CONSEQUENCES, the class should discuss the need for CONSTRUCTIVE 
CONSEQUENCES. (Frequently, chiMren beconte overly punitive and suggest excessive punishment, 
rather than constructive redress. Sometimes, children may let Terry off too easily, with a simple apology 
and no redress.) The class should discuss the difference between CONSTRUCTTIVE CONSEQUENCES 
(helping us thiiik, learn, and do better next time) and PUNISHMENT (helping someone to "get even.l 



5. Teacher summarizes the story and leads discussion of WHAT WE HAVE LEARNED —which may in- 
clude the dangers of playing with sticks, but should focus on the three LEARNING OBJECTIVES. 



ENRICHMENT: The Teacher should be alert to classroom situations which require "making good,** dur- 
ing the week or so following this lesson. On-the-spot problem solving and "dialoging** with children 
can be quick and brief, with the Teacher stressing CONSTRUCTIVE CONSEQUENCES. (It is 
possible that, for a short time, some children may test the issue by minor destructive acts. If the Teacher 
is consistent about insisting on (1) a statement of remorse, (2) appropriate restitution, (3) a statement 
regarding what has been learned for the future, the "testing** period should be fairly brief.) 
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Stimulus Cartoon and Background Information 




2 Tttchtfuyi'Th«pcin«itoOMtap«onibouyouv^ 
lthMSOfMotfWGMdran.1110 S#«Jhty»t pitying diiiogttitf* 

3 TinyhasaproMffl. Ltrt maM a sionf aboui Tany ioi«no pwttain Thai tay. wa can ha^ Tarry 



Bickgrpund mionnaMn 

AatwdaaatiaaloiolvtTarTya* proMn. t« toNvMnQ (m amarga 
• Tarry «na» to iMSChoal. 

. TbaaacMdrariplayadwt) Tarry yaaMiy. 

. Thayao flat 10 pnyiiit* Tarry today. Tbay ara vwng Tarnf, 



Tarry can at aitaraaorora^ff 
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Coding and Variables: 
Group Social Competency-Open Interview (GSC-OI) 

DESCRIPTION OF VARIABLES AND CODING 



I B: NOW kofonnttion — teacher provided 
IC: NOW aif(xmitk»--stiidem provided 
1 D: NOW infonnabcc — sicjation-itkvincy 

2B:, BETOREinfimnitkn-- teacher provided 
2X2: BEFORE infoiflMt^cn-- student provided 
2D: BEFt:MtEinfoniuttioa--situatk)n-iekva^ 

3B: PROBLEM — teacher provided 
3 C: PROBLEM —student provided 
3 D: PROBLEM — situition-relevincy 

4B: BESTENDING — leacherprovided 
4C: BEST ENIHNG — smdett provided 

SB: WORST ENDING — teacher provided 
SC: WORST ENDING — student provided 

6 A: ALTERNATIVES &CX3NSEQUENCES 

7 a: action PLAN —student provided 

8E: PSP SEQUENCE — provided 

9 A: SUMMARY NARRATIVE — provided 

IDA; STUDENT VOTE — provided 
(Categories: AJE noted presence of the designated variable - 
behaviprs; C noted student behaviors; D noted rele^attcy o[ 



Observation I empoihy 

Antecedent thinking 

Problem identification 

Positive goal-setting 

Targeted a^foidam 

Brainstorming solutions 

Planning acMdes 

Ordering suggestions 

Mewyory of events 

Consensus on plan 
A^yes/no lEmOJ2 ; B noted teacher 
behaviors on a 5 point scale) 



Group PSP SQlutiQn.CQntefit viriahlM 

• C-1 Compromise {eg: Ask diem, later, to pUy tomorrow.) 

• C-2 Direct Actkm (eg: Show them you know how to play: Play ball with someone else.) 

• C-3 Bargaining (e|:*TU give you my ball if lean play.*^ 

• C4 Verbal Assertion (eg: Say. **I have no one to play with.*^ 

• C-S Help*seeking (eg: Ask the leacher 10 make them share.) 

• C*6 VeiM Aggression (eg: Say.^'ni get even with your *1 don't li^^ 

• C-7 Physical Aggreasion (eg: Hit diem; trip them up.) 

• C-8 Non-con£rontation (eg: Give up; Go play by self.) 

iSoluaon^ontent variables -Afere coded on a 5 point scale) 

Group PSP! Solution-Tvpe Viriabtes 

• S-1 Alternate (ALT): («g: grab the ball (1); offer them gum (3); just join in (4); ask 

nicely to play (S) 

• S-2 Variant (WAR): (eg: take their ball (1); offer them candy (3); just play with them( 4); 

say.**May I pUy. please? (5). 

• S*3 Chain (CH): (eg: smile (3) at them and then, tomonow. go buy some randy, but not eat 

it all up by himself...) 

• SA Irrelevancy (IR): (eg: They shouldn't do that; basketball is more fun.) 
(Solution'type variables were coded for effectiveness on a 5-point scale) 
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TABLE 2 



BetwMn Group CHI Squart Comparisons 
PSP % Froqutncies 



Prolntervontlon PotMntorvotHlon 



hem 


Progr^fn 


Control 




Program 


(bomrol 




in 


1 J 


13% 


NS 


50% 


30% 


.06 


1C 


36% 


63% 


.0001 


63% 


79% 


.05 


2B 


0 


38% 


.0001 


75% 


29% 


.0001 


2C 








25% 


63% 


JHOOl 


3B 


11% 




.0001 




u 


.Will 




•Wlb 


■WI% 


NS 


M% 


75% 


.01 


4B 


13% 




.0001 


25% 


0 


.OCOl 


4C 


0 


13% 


.0001 


63% 


0 


.0001 


SB 


0 




NS 


25% 


0 


.0001 


SC 


0 




NS 


36% 


0 


.0001 


6A 


13% 


1t% 


NS 


75% 


6% 


.0001 


7A 


0 




NS 


M% 


0 


.0001 


8A 


Y3% 




.0001 


75% 


0 


.0001 


•A 


0 




NS 


63% 


0 


.0001 


IDA 


0 




NS 


•8% 


25% 


0001 



TABLE 3 

PSP RELEVANCY 
GROUP MEAN COMPARISONS 



PRE. INTERVENTION 


POST. INTERVENTION 


PROQRAU rONTROL 


PAOORAy CONTROL 


ID 66 16 NS 

2D 2 0 16 NS 

aP 3 6 a « NS 1 


3 1 2 4 NS 
2 4 2 6 NS 

3.9 19 Ot 


- -v 20 



PSP SEQUENCE DESCRIPTION 



1A NOW b i ^•senl^ 

« NOW Teactief pfovkted? 

1C NOW Sludwnl providad? 

10 NOW Fklevart to slimuhis^ 

2A BEFORE Is i pfts«<? 

2B BEFORE Taactwf JHOvmW^ 

2C BEFORE. Sludtm pfovidwj? 

20 BEFORE R#»wranl to stimulus? 

3A PROBLEM »:hil(K«S6nl? 

3B PROBLEM ID Taadiar idaoliW? 

3C PROBLEM ID. SludOTi idtnliftwP 

30 PROBLEM ID. Ftlwartllo stimulus? 

4A BEST ENDING: Is ipf6S«<? 

4B BEST ENDING: Ttadm providtd^ 

4C BEST ENDING: SlitiJ6nl pfOwd«J^ 

40 BEST ENDING: Ril6vanl to $limi*i$? 

5A WORST ENDING: Is I ptS6rtl? 
58 WORST ENDING: T6adi6r prowkW? 
5C WORST ENDING: Slud6nl prowJwl? 
5D WORST ENDING: R6ltvwi lo stimulos? 

6A ALTS/CONSEQUENCES f»ir«d? 

7A ACTION PLAN: Is I pr6SMl? 

8A PSP SEQUENCE: Is Hlolowed^ 

9A NARRATIVE SUMMARY Is i presenl^ 

1QA STUDENT CONSENSUS Do Ihey VOTE? 



I 



TABLE 4 

BETWEEN GROUP CHI SQUARE COMPARISONS 
SOLUTION % FREQUENCIES 




FIGURE 1 • B 
PBE.|NTE flVENTION: ALTERNATE V S STATIC 

100 yl 



FIGURE 1 • A 




eoHTRet. 



POST-WTEBVEMTION: ALTERNATE V8 STATIC 



POST-INTERVENTION SOLUTIONS 




ERIC 



1.' 
1.' 



TABLE 5 

ClilATE C / KTMfN GIKXJP COMPAHrSOHS 



1 


1 90 


1 r 


m 


1 30 


1 13 


m 


2 


1 00 


1 2S 


NO 


130 


1 00 


m 




1 IS 


I.M 


0.01 


1 03 


2.00 


m 


4 


200 


200 


m 


200 


1 00 


m 


5 


0 7S 


1 M 


oos 


1 M 

1 


1 SO 


m 


■ 


0 


0 


NO 


0 13 


0 


m 


7 


1 19 


1 7S 


m 


l.ftO 


1 so 


m 


n 


1 SO 


2.00 


NO 


100 


I.U 


m 


12 


003 


I.2S 


0 10 


1 13 


1 13 


m 


19 


1 30 


1.03 


NO 


1 00 


I.U 


NO 



TABLE 6 

aOMfET ttFVMECN GROUP MJ^N COMPARISONS 





T04E 1 






IME 2 




V r»gar«ai 


C«iilr«l 


C vahM 




CMlrAl 




(n.O) 


(n.O) 




(n-0) 


(n-0) 




• 


1 30 


20O 


0 0( 


1 00 


200 


NB 




I.M 


200 


0 01 


1 03 


1.7S 


NB 




0 12 




NO 


OSO 


000 


NB 








NO 


0 03 


000 


NB 








NB 


200 


0.00 


OOOi 








NB 


1 00 


000 


0 01 




0 37 


0 7S 


NB 


1 2S 


OSO 


NB 








NB 


1.00 


000 


0 01 






0 


NB 


OSO 


000 


NB 


20 




0 


NB 


OSO 


0 13 


NB 



Discussion "Cliimla" Hems 

(Inlorvol doU: Scoli « 0-2) 



1 CtMsA Ulio lums ocimiling fa) ao oigaiw 
l.Chi^p^tmnM^amtiimwmmmtmctMoii (nhandMMing) 

3 ChdonoHpotkomollum. 

4 CMim aro tfflofnMi mt^O Mlm «^ caltd on 

5 (MlMotfonol€lB«WiiQuoiMn0iMMS«i. 
e CMtfKMMSodtirnoiwMlMlsipMii 

7 CMdlr«idooollw|liil«lBOiopoin. 

0 TsidiofdtfoolinlwvptlowddhcMMion todbc^ 

9 ToodMf dooBAl NNWidktMiO how to Ml «pprQpnalil)f lor duoussNM 

10 ToachoruiotctooriiQn-viilMliiOMl. 



11. Chidno do Ml dmplk iMppropiiiloly lo oxprou poisonil nsod or ihouoM 

12. CMm do Mi oppoor boiod « unMoriM in groMp dtooioion. 

13 ChidfiO Mipofid lo ipodk ^yodion posod. 

14 Toocfcir diiigiiM tooM lads to tMdno. 
IS. Toadtor Mod tdami Mitoa ioadbadi 

16 TEodiOf MM jnyWc ioadbadi. 

17 TooclMOi«dDrooMMMpartalloclMto9(NOI«). 
II ToodMoMoMOtioaoOM port dIod-fMino (NOW). 
10 Toodiar a^ptoMO imiQMi M pM of laclMnQ 

20. ToodM dtaiaoM mol N dial doooitl wA; alar /Ultoii P^^ 



Er|c 22 



*33 



